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INTRODUCTION 


The  operational  methods  of  Heaviside— as  embodied  in  a 
consistent  application  of  the  Laplace  transform— have  made  a  profoiind 
impression  upon  several  areas  of  applied  mathematics  and  engineering. 
Indeed,  it  is  safe  to  say  that  at  least  one  field—the  theory  and  prac- 
tice of  automatic  control  systems — probably  would  not  have  survived 
its  infancy  without  the  niirsemaid  of  operational  calculus.    Thus  we 
find  that  the  mathematical  language  of  the  contemporary  control  theor- 
ist or  engineer  is  couched  almost  exclusively  in  terms  of  the  complex 
frequency  plane,  i.e.,  the  domain  of  the  Laplace  transform  variable. 

During  World  War  II,  a  new  class  of  control  systems  aroused 
the  Interest  of  control  analysts.    These  systems— known  generically 
as  sampled- data  systems — differed  from  control  systems  theretofore 
considered  in  that  the  input  signal  or  actuating  error  of  the  new 
type  of  system  was  known,  or  could  be  specified,  only  on  a  denumerable 
subset  of  the  temporal  continuum.    Thus,  an  acceptable  mathematical 
model  of  such  a  signal  can  be  taken  to  be  an  infinite  sequence  of 
real  numbers. 

Since,  as  has  been  indicated,  operational  methods  are  the 
sine  qua  non  of  contj-ol  system  analysis,  it  was  natural  that  control 
analysts  should  attempt  the  application  of  similar  methods  to  the  study 
of  the  new  type  of  system.    However,  inasmuch  as  the  workers  in  this 
new  field  evidently  were  acquainted  with  the  theory  of  linear  operators 
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only  insofar  m  it  is  axewplified  by  uae  of  the  Laplw;«  tr»n»f orm,  the 
attempted  analysis  of  aanpled-data  systeas  infolved,  fundsMntally, 
a  modification  or  variant  of  this  transform.    Of  the  success  attending 
these  attempts  more  will  be  said  shortly. 

At  about  the  sane  time  that  interest  was  being  directed  toward 
the  new  class  of  control  systems,  inrestigations  were  initiated  concern- 
ing the  developiBent  of  an  operational  technique  for  the  approximate— 
or  numerical—analysis  of  the  older  class  of  control  systems  which 
have  come  to  be  known  as  continuotis-data  systwns  to  distinguish  them 
from  sampled-data  systems.    Here  again  the  mathematical  entity  of 
fundamental  importance  was—and  is— the  infinite  sequence  of  real 
numbers    and,  again,  operational  methods  involving  modifications  of 
the  Laplace  transform  have  played  a  dominant  role  in  these  investigations. 

The  developments,  on  the  one  hand,  of  the  theory  of  saxapled- 
data  systoBS  and,  on  the  other,  of  the  just-mentioned  approximate 
methods  have  proceeded  independently,  albeit  concurrently.    In  both 
Instances,  application  of  the  Laplace-operator  methods  has  been  an 
outstanding  success  from  a  purely  practical  engineering  standpoint. 
However,  what  has  been  developed  purports  to  be  a  mathematical  theory 
and  it  is  on  a  mathematical  basis  that  this  theory  is  open  to  consider- 
able criticism.    Vfe  shall  not  labor  this  criticism  here    but  will 
comment  to  a  greater  extent  upon  it  in  the  introductory  remarks  to 
Chapters  II  and  III.    It  suffices  for  the  present  to  state  that  the 
developments  we  have  been  discussing  cannot  be  considered  mathemat- 
ically rigorous. 
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Certainly  one  function  of  the  applied  matheaatician  is  to 
endeavor  where  possible  to  render  rigorous— to  paraphrase  Bellnan— 
the  half-intuitire  but  wholly  ingenious  mathematical  techniques  of  his 
colleagues  in  the  physical  sciences.    When  successful,  such  endesTors-- 
in  order  to  aroid  the  stigma  of  triviality—should  lead  to  new  conclu- 
sions about  the  systems  with  ^ch  they  are  concerned  or  at  least  open 
a  path  to  the  discovery  of  new  results. 

These  remarks  lead  up  to  the  purpose  of  this  dissertation,  ^ch 
is  to  present  a  rigorous  and,  it  is  hoped,  non-trivial  formilation  of 
the  Mathematical  theory  of  sampled-data  systems  and  of  the  approximate 
operational  technique  discussed  earlier.    This  purpose  is  accomplished 
in  the  following  way:    in  Chapter  I,  portions  of  the  theory  of  infinite 
matrices  are  employed  in  the  study  of  certain  algebras  of  linear  trans- 
formations on  the  space  of  all  sequences  with  complex  entries.  In 
Chapter  II,  the  considerations  of  the  first  chapter  are  employed  to 
formulate  a  mathematical  theory  of  sampled-data  systems.    Finally,  in 
Chapter  III,  the  sane  considerations  are  utilized  in  the  derivation  of 
an  operational  technique  for  numerical  quadrature,  this  technique  in 
turn  being  applied  to  the  approximate  solution  of  linear  ordinary 
differential  equations. 


CHAPTER  I 


INFINITE  MATRICES  AND  LINEAR  FILTERS  ON  a 

Introduction. — In  thia  chapter,  two  special  classes  of  infinite 
■atrlces  are  defined  and  their  algebraic  and  topological  properties 
discussed.    The  i^lationship  between  one  of  these  classes  of  Biatrices 
and  an  important  class  of  linear  transformations  on  a  sequence  space 
is  derived  and  discussed.    The  treatoent  here  leans  heavily  on  that  of 
Cooke  [1]^  for  theorems  on  infinite  matrices.    Only  those  results  of 
vise  in  the  applications  of  the  subsequent  chapters  are  set  down;  as  a 
consequence,  the  analysis  is  concise  and  of  an  elementary  nature. 

Definitions. — ^An  infinite  matrix  is  an  array  A  -  (a^j)* 
1,  j-1,2,5,  .  .     of  conqplex  numbers  with  matrix  addition  and  matrix 
and  scalar  multiplication  defined  by 

A+B  -  (a^j  ♦  bj^j)  (1.1) 

00 

AB  -  (  2  ^^'^^ 
XA  -  (Xa^j)  (1.5) 

CO 

where,  in  (1.2),    Z    ^jj^^j       assumed  to  exist  for  every  1,  j. 

We  shall  need  two  main  classes  of  infinite  matrices:  the 
lover  semi -matrices  (l.s.m.)  and  the  diagonally  Invariant  matrices 
(d.i.m.).    A  matrix   A  -  (a^^j)  is  said  to  be  a  l.s.m.  if  and  only  if 

lumbers  in  square  brackets  refer  to  the  List  of  Refei^nces 
preceding  the  Appendix. 
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a^j  -  0  for  j  >  i 
idxile  A  i«  a  d.i.n.  if  and  only  if  it  is  a  1.b.».  and 

a^j  •  a^_^  for  every  i,j. 
ThuB,  pictorially,  we  have  for  a  l.s.m.  A 


la^   0       0  0 

•21  *22  0  ° 
*S1    ^52    *^55  ° 


•nl    *n2    *n5  * 


0 
0 

0 


a      ,    a  0 

n, n-1  nn 


and,  if  A  is  a  d.i.K, 

0  0 

°1  '^O  ° 
^  *1 


0 
0 
0 


a   ^    a    -    a    .  . 
B-1     n-2  n-5 


0 
0 
0 


•  «1   *0  ° 


:\ 


¥e  shall  denote  the  set  of  all  l.s.m.  by  oC  and  the  set  of  all  d.i.i 

by 
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Denoting  by  a  the  linear  rector  space  of  all  sequences  with 
convex  entries,  the  equations 

n 
k-0 

iriiere  a^,    7^,       are  coB5)lex  nuiabers,  constitute  a  linear  trans- 
fomation  of  a  on  itself.    When  a^  ■  b^_j^,  the  transforaation  deter- 
Bdned  by  (1.4)  will  be  called  a  constant  linear  filter j  otherwise,  a 
variable  linear  filter.^ 

Using  any  one  of  the  following  notations 

U  -  (Uq,  Up  Ug,    .   .    .)   -  (Ujj)  (l.S) 

for  (row)  vectors  in  a,  (1.4)  may  be  written  as  the  vector-matrix 
equation 

y'''  -  AxT  (1.6) 
where  AB<^when  (1.4)  represents  a  variable  filter  and  Aco^when 
(1.4)  represents  a  constant  filter.    The  superscript  T  denotes  the 
transposed  vector.    Hereafter,  this  notation  will  be  dropped  since 
it  will  be  obvious  fl'om  the  context  whether  a  row  or  coluian  vector 
is  intended. 

Al^braie  character  of  oC  and       .  Reciprocals. ~  3C  and  o^are 
completely  characterized  algebraically  by  the  following  statement: 
with  the  operations  defined  in  (1.1),  (1.2),  (1.5),  ^  is  a  non-Abelian 

falling  such  transformations  filters  anticipates  the  appli- 
cation to  be  made  in  the  next  chapter,  for  control  engineers  freouentTy 
rerer  to  a  linear  transmission  sjrstem  as  a  filter  [7],  1  --v 
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algebra  with  unit  alonent  orer  the  complex  field  and       Is  an  Abelian 
sub-algebra,  with  unit  eleaent,  of  ^  .    Moreover,       contains  no  proper 
divisors  of  »ero.    The  definition  of  "algebra*  used  here  is  that 
of  [5],  pp.  19,  20.    For  the  convenience  of  the  reader,  the  definition 
is  reproduced  in  the  Appendix.    Cooke  [1],  p.  7  ff.,  in  effect  has 
shown  that       is  a  non-Abelian  ring  with  unit  element  while  Matthews  [2] 
has  shown  that  ^  is  an  Abelian  ring  with  unit  elenent  but  without 
proper  divisors  of  sero  (integral  domain) .    The  remaining  conditions 
that      and  ad^  mast  satisfy  in  order  to  be  classed  as  algebras  are 
immediate  consequences  of  the  definitions  (1.1),  (1.2)  and  (1.3). 

On  the  basis  of  theorems  proved  for  l.s.m.  in  [1],  ch.  2, 
we  may  state  that,  if  Ae  *C  and  a^^  /  0  for  every  i,  then  A  has  a  unique 
(two-sided)  reciprocal,  A~^,  in  ^  whose  principal  diagonal  elements 
are  equal  to  1/*^^^-     Moreover,  if  a^^^^  -  0  for  some  i,  then  Ae  £,  has 
no  reciprocal  in     ,  either  left-hand  or  right-hand.    It  follows  from 
[1],  p.  25,  that,  if  A,  Be  <^  are  non-singular,  then  B""^A""^  -  (AB)""^ 
and  A"-'-(l  +  BA"-*-)""^  -  (A  ♦  B)""^. 

A  xiseful  algorithm  for  the  determination  of  the  reciprocal  of 
Ae       is  readily  established.    Let  B  ■  (b^j)e()Cbe  the  unique  reciprocal 
of  A.    Then  the  k-th  row  of  the  product  BA  equals  the  k-th  row  of  the 
unit  matrix.    Clearly,  the  nonxero  eoa^onents  of  the  k-th  row  of  BA  can 
be  obtained  from  the  finite  vector-matrix  equation 


"B  is  said  to  be  a  two-sided  reciprocal  of  A  if  both 
AB  •  I  and  BA  •  I. 
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kl  "k2 


'^11  0 


0  0 
0      ...  0 


(0  0  ...  0  1). 


(1.7) 


Denoting  the  finite  matrix  of  (1.7)  by  A^,  we  hare  the  well-known  reeult 

-  adjAj^  det  Aj^  (1.8) 
where  ad  J  Aj^  and  det  Aj^,  as  defined  in  [4],  ch.  4,  are  respectively 
the  matrix  adjoint  to       and  the  determinant  of  Aj^. 
Evidently 


det  Aj^  ■    n  ajj. 
I"l 


(1.9) 


k  k 
Letting  adj  Ay,  ■  (Jj^j)>  we  clearly  need  only  determine  j-1,2,  ...,k. 


But 


^kj  "  <^o^*ctor  ajjj 

-  (-1)^"^   n    a,,  det 


l-l 


where 


det  a,j^  -  1 


det  u) 


kj 


'5*1,3    Vl,j+l         °  ° 


Vl,j    Vl,j+1  Vl,J+2 


*k,j+l  *k,j+2 


0 
0 


0 

0 


Thus 


k 


•  ®k-l,k-2  Vl^-l 

•  *k,k-2  ^,k-l 


1^^^   •  •  vie 

1  ?  1 

^  y  »^  y       y    •   •  • 


^^■l^Sj    •  •  •  y  k-"l* 


(1.10) 
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Altenxativwly,  a  recursion  »ch©B«  results  directly  and  sin^y 


ftroa  (1.7): 
-1 


If  AeoS;  then  a^j  -  a^_^  and  (l.lO)  becomes 


'         ,k-J  ,  k-j+1 


(1.12) 


vhere 


det  M'Q  «  1 


det 


0  0 
«2  ^  ° 


0 
0 


S     VlV2---      *2  *1 


(1.13) 


Let  us  now  introduce  the  d.i.m.        ■  ^^J^  defined  by 

"  ®i-j*l,n+l»      ^  ■  °»^»^>***>  (1.1*) 
where  6^^.  is  the  Sronecker  delta.    Pictorially  we  have 


i^re  the  notation  on  the  right  indicates  a  row  partition  of  the  aatrix 
in  which  the  upper  subnatriz  consists  of  n  rows  of  zeros  and  the  lowo* 
submatrix  is  the  unit  aatrix.    Thus  Dq  «  I,  the  unit  aatrix,  and  it  is 
easy  to  see  that  satisfies 

\  '  \  '  Vn»  "''^  -  (1.15) 

and,  hence,  that 

-  Dj^,         -  0,1,2,...  . 
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If  Ce  cd"  and  C  /  0,  then  it  is  evident  that  there  exists  a  unique 
nott-negatire  integer  n  such  that 

C  -  D^A 

lAere  A  is  unique  and  iK>n- singular .    If  n  /  0,  then  A  will  be  called 
the  pseudo-reciprocal  of  C  and  it  follows  that 

CA'-^  •  A'-'-C  .  Djj. 

Pseudo-reciprocals  can  be  defined  in  the  sane  fashion  for  so»e  aiatrices 

in  the  ccaapleBcnt  of  ^  in  <^  . 

A  useful  property  of  the       appears  in  the  following 

Theorem  I.    Let  CX  -  E  where  C-DA,  E-DB  with  A,Be  cd'  non-singular. 

n  Bi 

Then  a  necessary  and  sufficient  condition  (n.a.s.c.)  that  the  equation 
have  a  unique  solution  X  in       is  that  m  >  n. 
The  condition  is  sufficient,  for 

D  AI  -  D  B 

n  IB 

and,  iBultiplying  on  the  left  by  A~^  and  applying  (l.lS)  and  the 
ccHBoutatiTe  property, 

D  X  -  D     D  A"-^. 
n        m-n  n 

Finally,  ^  •  D  A"-^, 

since  the  cancellation  lavs  hold  in 

For  the  necessity,  let  X  -  D^^F,  where  F  is  non- singular. 
"Bien  froB  the  given  equation 

D^iyiF  - 
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Hence,  we  imi«t  hare  B(AF)~^  •  D^.  But  B(AF)~^  is  itaeli"  non-«ljagularj 
consequently  p  -  0.    From  the  resulting  equation, 

the  theorem  follows. 

Conrergence  and  Sumaability  in  a,  cC  and       .  — Let 

k        k    k  k 
X   ■  ^^Q»^>  •••)»  k  "  0,1,2,..., 

be  a  sequence  of  rectors  in  a.  The  sequence  will  be  said  to  converge 
to  the  rector  x  •  ix^,x^fX^, . . . ,x^, . . .) — written 


-if  and  only  if 


o-lia  :^  -  X 

k^oo 


lia  xi[  -  x^,  n  •  0,1,2, ...  . 
.         n      n  i  >  I 

k-^co 


,.,k,kOkl  kn 

Let  A    -  (a    ,  a    ,  a    ,  ...),  k  -  1,2,5,...  ,  be  a 

sequence  of  matrices  in       ,  idiere  a^''  denotes  a  eoluan  rector— 

in  a—  of  A^.    Then  the  sequence  A^,  k  -  1,2,5,...  ,  will  be  said 

to  conrerge  to  the  matrix  A  -  (a°,a"^,  a°,  ...) e —written 

i^C  -lim  A^  -  A 
k-><x> 


— if  and  only  if 


o-lim  a^  -  a°,  n  -  0,1,2,...  . 


k->-oo 

An  analogous  definition  obtains  for 

<^-llJB  A^. 
k->oo 
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These  limit  processes  are  examples  of  what  Cooke  [1],  p.  285,  calls 
coordinate  (c-)  convergence.    It  can  be  shovm,  although  we  shall  not 
need  the  fact  here,  that  metrics  can  be  defined  in  a  and       in  such  a 
way  that  the  resulting  metric  spaces  are  topologically  equivalent  to 
the  spaces  o  and  oC  with  the  just-defined  topology. 

It  is  apparent  that  the  mapping  which  assigns  to  each 
A  -  (a^  j)6       the  vector  a  -  (0^,0^, . . .) 6°    is  a  homeomorphism.  The 
correspondence  is  preserved  moreover  by  all  the  algebraic  operations 
for  td'  and  a,  where,  in  the  latter,  multiplication  is  defined  by 

Let 

y  -  Ax 

where  A  is  an  arbitrary  infinite  matrix,  not  necessarily  in  <^  .    A  will 
be  called  a  Kojima  (K-)  matrix  whenever  the  following  conditions  are 
satisfied  [1]: 

00 

i)      Z    |a^|  <  M  for  every  n 
k-1 

ii)      lim  ajj^  -       for  every  fixed  k  (I.I6) 
n-^oo 

00 

iii)      lim       Z    a^^j^  -  a. 
n->oo  k-1 

The  numbers  a,       are  called  the  characteristic  numbers  of  the 

K-natrix.    If  a,  -  0,  we  shall  call  A  a  T  -matrix;  a  T, -matrix  is 

k       '  a  '  1 


For  an  illustration  of  this  fact  for  a,  see  Cooke  [1],  p.  315. 
The  demonstration  for       is  a  commonplace  extension  of  the  concept 
of  metric. 
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usually  called  a  Toeplitz  (T-)  matrix.  If  (1.16, i)  alone  is  satisfied, 
A  is  called  a  Kp-matrix. 

Two  theorems  on  K  and  Kj.  matrices  are  important  in  the  present 
connection.    These  appear  in  [1],  pp.  65  and  299,  and  are  presented 
here  without  proof. 

Theorem  II  (Kojima-Schur) .    A  n.a.s.c.  that  the  sequence 

00 

^n  ■    ^    ^k^k»  "  ■  1»2,3, ...  ,  (1.17) 
k-1 

converge  when  Xj^  does  is  that  (a^j)  be  a  K-matrix.  Moreover 


lim      ■  X  implies  that 
n-^-oo 

00 

y  -    lim  yj^  •  ox  ♦    2    aj(.(xi^.-x) .  (1.18) 
n^oo  k-1 

Theorem  III  (Kothe-Toeplitz) .  Suppose 

00 

Z    la^ijl  <  00  (1.19) 
k'l 

for  every  n.    Then  a  n.a.s.c.  that  y^  of  (1.17)  be  bounded  vAen  is, 
is  that  (ftji^j)  be  a  Kj,-matrix. 

Clearly,  vhen  kt  £   (1.19)  is  satisfied.    Thus,  denoting  by 
the  space  of  all  bounded  sequences  and  calling  a  l.s.m.  stable  when  it 
maps  *^QQ  on  itself,  we  may  state 

Theorem  IV.    Ae  £  is  stable  if  and  only  if  it  is  a  Kj.-natrix. 
Corollary  IV.    Let  A  -  (a^_j)e  <^  -    Then  A  is  stable  if  and  only  if 

00 

2    jajjl  <  00  . 
k-0 

Apparently,  a  stable  d.i.m.  is  a  T^-matrix. 
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Dl«placemant  triKforaatlonB  on  a. — The  set  of  all  matrix  poly- 
nonlals  of  the  form 

F(D)  ■  a^I  ♦  a^D^  ♦  ...  ♦  a^D^  (1.20) 
-  a^I  ♦  a^D^  ■«•...+  a^CD^)'^ 

fonw  a  connutatlve  ring  with  unit  element.    The  proof  is  siallar  to 
that  giTen  in  [4],  p.  157  ff.    It  ia  a  trivial  natter  to  show  that  the 
■et  of  all  Buch  polynoadals  i»  dense  in  e^,  in  the  topology  established 
for       in  a  prerious  section. 
Using  the  equation 

D^(xq,i^,X2,...)  -  (0,Xq,x^,...)  (1.21) 
as  a  guide,  let  us  define  a  transf omation,  £'^,  on  9  as 

ir\x^,x^,T^, . . .)  -  (0,Xq,x^,...).  (1.22) 
FroB  (1.22)  we  have,  recursiTely, 

(E"^)^  X  -  E'-'-(r^)^"-^  X,  k  -  2,5,4,...  .  (1.25) 
If  we  define  (E"-'-)°  -  1,  then  (1.25)  holds  f or  k  -  1  and,  to  simplify 
the  notation,  we  define 

E"^  -  (E""^)^  k  -  1,2,5,...  .  (1.24) 
As  with  the  matrix  polynomials  of  (1.20),  it  can  be  shown  that  the  set 
of  all  polynomials 

■»•  a^E'-^  ♦  .  .  .  +  a^E"°  (1.25) 
over  the  c<Hsplex  field  forms  a  comma tatiTe  ring  with  unit  elmaent. 

Now  let  (Tjj)  be  a  fixed  Tector  and  let  a^,  r  •  0,1,2,...,  be 
an  arbitrary  sequence  of  fixed  complex  niud>ers.    Then  the  sequence  of 
vectors  u'*  defined  by 
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is  such  that 


where 


-  {  Z    a  E-^(t  ),  m  -  0,1,2,...  (1.26) 
r-0    ^  ° 


a-lim  u™  -  u 


-        for  n  <  ffl. 

Equations  (1.26)  thus  imiquely  determine  a  linear  transformation  of 
(v^)  onto  (u^).    We  may  say  that  the  sequence  of  transformations 

ra 

Z    a^E"^,  m  -  0,1,2,. ..,  (1.27) 
r-0 

converges  to  a  transformation  Vihich  we  shall  denote,  with  an  obTious 
interpretation,  by 

00 

Z    a_E"^.  (1.28) 
r-0 

We  shall  call  such  transformations  displacement  transformations. 

It  follows  from  our  construction  that  the  product  of  two  such 

transformations  is  just  the  Cauchy  product 

00  00  00  r 

{I    ajj;-^}{Z    b^-^}  -    Z{Z  a.bj.,)E-^. 
r-0  r-0  r-0  j-0  ^ 

Also,  under  the  topology  introduced  it  is  easy  to  see  that,  as  is  the 

case  in  o^",  the  set  of  all  polynomials  (1.25)  is  dense  in  the  space  of 

all  displacement  transformations.    The  correspondence 

then  establishes  a  blcontinuous  isomorphism  of  ei^"  onto  the  space  of 
all  displacement  transformations. 
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(un)  -  {  Z    UrE-''}6°  .  (1.52) 


The  notation  (uq,u-j^,U2,  . . .)  in  (1.5)  for  vectors  in  a  pre- 
supposes a  particular  choice  of  a  basis  for  o  relative  to  which 
UqjUj^jU^,  . . .  are  the  coordinates  of  u.    The  set  of  vectors 

c'^  -  (6^),  r  -  0,1,2,...,  (1.50) 
Mbiere  5j^.  is  the  Kronecker  delta  forms  such  a  basis,  in  terms  of  which 
(Ujj)  has  the  unique  representation 

(u^)  -    ?  u.c^.  (1.31) 
r-0 

Applying  the  previously  deduced  convergence  properties  of  displace- 
ment transformations  to  (1.31)  we  obtain 

00 

Z 

r-0 

Thus,  if  we  adhere  to  use  of  the  e-basis — as  we  shall  in  the  sequel — 
we  see  that  the  study  of  constant  linear  filters  on  a  of  the  form 

k"0 

is  equivalent  to  study  of  displacement  transformation  equations  of  the 
form 

00  00  00  _ 

{  2    7r^~^]^    -  {  2    ^^~^]{  2    Xjj;'^}e"  (1.34) 
r-0  r-0  r-0 

or  of  the  corresponding  matrix  equations  in  o^.    The  retention  of  the 

vector  e*^  in  (1.34)  is  evidently  superfluous. 

Under  the  isomorphism  established  by  (1.29),  multiplicative 

inverses  correspond  so  that  the  coefficients  of  the  serial  expansion 

of  the  inverse  of  (1.28)— assuming  its  existence — are  given  by  (1.12). 
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The  same  result  is  obtained  [5]  by  carrying  out  the  formal  reciproca- 
tion 

[  1    a  E-^]-^  -  1/  ?  a  E"^.  (1.55) 
r-0    ^  r.O  ^ 

We  could  now  carry  out  a  discussion  of  pseudo-inverses  of  singular 
displacement  transformations,  but,  since  the  analogy  vdth  pseudo- 
reciprocals  is  precise,  the  discussion  will  be  omitted. 

By  virtue  of  the  foregoing  considerations,  every  Maclaurin's 

series 

00 

Z    a_z-^  (1.36) 
r-0 

where  z"-'-  is  a  complex  variable  becomes  a  valid  displacement  transfor- 
mation when  z"-^  is  replaced  by  E"-^.    This  is  true  even  if  (1.56)  conver- 
ges only  trivially. 

If  (1.36)  should  happen  to  have  a  non- trivial  circle  of  con- 
vergence and,  as  a  consequence,  uniquely  represent  an  analytic  function 
within  that  circle,  and  if,  in  addition,  the  function  so  represented 
can  be  expressed  in  closed  form,  then  a  new  definition,  convenient  for 
the  applications,  suggests  itself. 

Let  A(z"^)  denote  the  closed  form — now  assumed  to  exist — of 
the  function  (1.56).^    Then  we  define  the  transfontiation  A(E~'^)  as 

A(E"-^)  -    2  (1.37) 
r-0 


°0r,  more  generally,  we  can  let  A(z~  )  represent  the  analytic 
configuration  obtained  by  continuing  (1.36)  along  every  path.  (Cf.,[6]). 
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On  the  other  hand,  any  function  A(z~-^)  analytic  in  a  neighborhood  of 
-  0  leads  to  a  transformation  •A(E"-'-)  which  will  be  defined  to  be 
equal  to  its  Maclaurin's  expansion.    In  this  case  ACE""^)  is  well  defined 
since,  by  Cauchy's  integral  formula,  the  coefficients  a^  are  uniquely 
determined  by 

•r-^Mo)  .j^/,^dc  (1.58) 

where  C  is  a  simple  closed  curve  about  z"^  ■  0  which  excludes  the  singu- 
larities of  A(  z"-^) .    Even-  more  important  for  the  applications  is  the 
fact  that  the  series  in  (1.57),  when  A(E"'^)  is  a  fractional  rational 
transformation,  can  be  obtained  by  division  of  the  numerator  by  the 
denominator  of  A(E~^) . 

As  will  be  seen,  the  most  important  class  of  fractional  rational 
displacement  transformations — from  the  standpoint  of  applications  at 

least — is  that  given  by 

\{iE-^)  -    Z    T^aTE-^  (1.39) 
r-1 

Sn(aE"^) 
(1-aE  ■^)"*-^ 

where  a  is  complex  and 
Sq(z)  -  z 

n  q-1 

S^(z)  -    Z      Z    (-l)™(n+l;m)(q-ra)"z^,  n  -  1,2,3, (1.41) 
q-1  m-O 

with  (njj)  «  nl/[  j'.(n-j)  t  ] .    The  properties  of  the  functions  '^^{z)  and 
S^(z)  have  been  investigated  in  detail  by  Lawden  [7]. 

The  stability  criterion  of  Corollary  IV  has  a  convenient 

00 

expression  for  displacement  transf onnations .    Let    Z    a  E"'^  be  the 

r-0 
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image  of  the  d.i.m.  A  of  the  corollary  under  the  mapping  (1.29).  Then 
it  can  be  shown  by  a  proof  precisely  similar  to  tliat  of  Hiurewicz  [6] 

00 

that  A  is  stable  if  and  only  if   Z    a^z~^  has  no  singularities  within 

r-O 

or  on  the  circle  |z~^|  -  1;    A  will  be  unstable  if  there  is  at  least 

one  singularity  in  |z"''"|  <  1.    The  case  of  a  singularity  on  |z"-^l  -  1 
represents  a  condition  of  marginal  stability. 


CHAPTER  II 

FCRMJIATION  OF  THE  THEORY  OF  SAMPLED-DATA  CONTROL 

Introduction. — As  reference  to  the  pertinent  literatiire — 
■aeh  of  lAich  ia  cataloged  in  [8],  [9]  and  [10] —reveals,  a  relatirely 
rich  theory  of  «aflq3led-data  control  systems  has  been  developed  since 
the  Initial  work  of  MacColl  [11]  and  Hurewicz  [6].    Extensive  use  of 
idiat  has  come  to  be  known  as  the  "a-transfora"  has  inparted  to  this 
theory  an  operational  character  analogous  to  that  of  the  theory  of 
continuous-data  control  systems  idierein  Laplace  transforms  are  utiliasd. 

While  the  utility  and  power  of  a-transform  methods  are  well 
substantiated,  the  ftodanental  formilation  of  the  z-transfora  concept 
is  open  to  question  by  the  matheBatieian.    Indeed,  control  engineers 
themselves  are  by  no  means  in  complete  agreement  on  this  point.  Tbaia, 
while  the  coiq>lex  series 

00 

Z  f(rh)£~^ 

— where  f(i*),  r  -  0,1,2,,..,  are  the  successive  values  of  a  real- 
valued  function  f(t)  of  the  real  variable  t  and  h  is  a  small  positive 
constant — is  usually  referred  to  as  tJie  z-transform,  it  is  not  agreed 
in  existing  treatments  whether  it  is  to  be  regarded  as  the  transform 
of  the  function  f(t)  or  only  of  the  sequence  {f(rh)}.    The  question  is 
important,  for  in  the  former  case  a  unique  inverse  transform  does  not 
exist  while,  in  the  latter,  a  \mique  inverse  does  exist. 
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In  •ome  instances,  the  series  appears  as  the  result  of  Laplace 
transformation  of  the  series 

00 

Z  f(t)6(t-rh) 
r-0 

and  a  subsequent  chan^  of  yariable.    Here,  6(t)  denotes  Dirac's 
iupulse  function.    The  questions  of  rigor  accruing  to  the  use  of  the 
Dirac  function  in  the  above  connection  have  not,  to  Ji^jr  knowledge,  been 
answered  in  the  literature  of  sau^jled-data  control. 

A  consideration  of  ihe  applications  of  the  z-transfor»  makes 
evident  the  fact  that  its  principal  rirtue  is  the  facility  it  confers 
upon  the  carrying  out  of  certain  algebraic  operations  with  sequences 
of  function  values.    Moreover,  the  fact  that        is  a  synbol  for  a 
conqplax  variable  is  of  no  particiilar  ijiQX>rtance  for  the  appliceatioms 
except  pei^iaps  in  considerations  of  stability.    This  latter  advantage 
seess  hardly  to  eospensate  for  the  questions  of  convergence  raised  by 
retention  of  the  eoDplez  function  fora. 

These  facts,  together  with  certain  indications  in  the  work  of 
Hurewiez  [6],  Friedland  [12]  and  Zadeh  [15],  suggest  a  treatment  of 
sanpled-data  systens  as  linear  transforaations  on  a  sequence  space. 
In  this  chapter  such  a  treatment  is  developed  utilizing  the  theory 
expounded  in  the  first  chapter. 

The  present  approach  provides  a  unified  treatiasnt  of  both 
time-invariant  and  time-varying  sampled-data  systems,  free  of  the 
Dirac  function  and  of  superfluous  dependence  on  coniplax  function  theory; 
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both  the  "classical"  and  Jury's  "modified"  z- transform  [14]  appear 
unimpaired  for  engineering  applications,  with  questions  relating  to 
inverse  transforms  resolved. 

Sampled-data  systems  as  linear  filters  on  a . — Sarapled-data 
systems  generally  occur  in  two  distinct  ways  in  practice.    One  is  ex- 
emplified by  the  digital  computer  which  operates — linearly  or  non- 
linear ly — on  a  sequence  of  numbers,  the  input,  to  produce  another 
sequence  of  numbers,  the  output.    The  other  is  exen^jlified  by  the  con- 
tinuous-data system,  such  as  a  servomechanism,  operating  on  a  piece- 
wise  constant  input,  where  the  discontinuities  of  the  input  are  usually 
assumed  to  be  equidistantly  spaced.    We  shall  consider  here  the  applica- 
tion of  the  matrix  theory  developed  in  the  preceding  sections  only  to 
the  second  type  of  (linear)  sampled-data  system  alluded  to  above. 

The  set  3-  of  all  piecewise  continuous  complex  valued  func- 
tions defined  on  the  non-negative  real  axis  and  zero  elsewhere,  forms 
a  linear  vector  space  over  the  complex  field,  with  obvious  definitions 
of  addition  and  multiplication  by  a  scalar.    Now  let  f*  denote  the  set 
of  all  vectors  which 

i)    f^  is  a  piecewise  continuous  complex  valued  function 
of  T    for  xe [0,1],    k-  0,1,2,.... 

^k+1  -  4'    ^  -  . 
Then  the  class  3f-^of  all  sets  f^  is  a  linear  vector  space  over  the 

complex  field  with  addition  and  scalar  multiplication  defined  by 
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cf*-{(pj  1  Pj-c^?. 

n        n  n 


♦  ^* 

Now  if,  for  f  e  J-  ,  we  put 

fj  -  f[(k+T)h],    0  <  T  <  1  (2.1) 

•  0  ,  elsewhere 

where  f(t)6  3- and  h  is  a  positive  constant,  then  the  inapping 

f(t)^f*  (2.2) 
is  an  isomorphism  of  3"  onto    2F-*  while  the  mapping 

f(t)-^(fj  (2.3) 
for  a  fixed  ralue  of  Te[0,l]  is  a  homomorphisni  of       onto  a. 

A  linear  automatic  control  system  with  input  f(t)  and  output 
y(t)  is  described,  under  wide  conditions,  by  an  integral  equation  of 
the  form  [15] 

t 

y(t)  -  ^  w(t,n)f(n)dM  (2.4) 
where  w(t,T) — frequently  referred  to  as  Gi*een's  function — is  a  contin- 
uous function  of  T6[0,t]  for  every  positive  t  and  w{t,i)  -  0  for  t  >  t. 
When  the  parameters  of  the  system  are  constant  in  time,  then  w(t,T)  has 
the  form 

w(t,n)  -  v(t-ji).  (2.5) 
Thus  (2.4)  is  a  linear  transformation  of  3^  into  itself. 

If  we  choose  a  value  of  h  >  0  and  define  f(t)  such  that 

f(t)  -  f -  constant,  kh  <  t  <  (k+l)h,  k  -  0,1,2,...,  (2.6) 
then  the  set         3^  of  such  functions  is  mapped  linearly  into  3"  by 
(2.4)  and  we  have  a  sampled-data  system  of  the  second  type  discussed 
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at  the  outset.    Indeed,  using  (2.6)  and  putting  t  •  (n+T)h,  0  <  t  <  1, 
(2.4)  can  be  written  as 

n  (k+l)h 
y[(n+T)h]  -    Z    f      /      w[(n+x)h,n]d|i  (2.7) 
k-0  kh 

where  account  has  been  taken  that 

(m-t)h  (n+l)h 
/      w[(n+x)h,Mi]dji  -     /  w[(n+T)h,ti]d(i. 
nh  nh 

Hence,  putting 

^  (k+l)h 

*=nk  ■     ^      w[(n+T)h,ML]4i,  (2.8) 
kh 

(2.7)  becomes 

n 

y[(n+T)h]  -    Z    c^fj^.  (2.9) 
k>0 

Using  (2.1)  and  (2.2)  we  obtain  y*  as  the  set  of  all  vectors  in  a  of 
the  form 

a  variable  linear  filter. 

For  the  case  (2.5),  we  have 

a  constant  linear  filter  on  n,  where 

^  (n+T)h 

-     /  v(X)dX.  (2.12) 

"  (n-l+T)h 

Thus  it  is  seen  that  the  analysis  of  linear  sampled-data  systems 
is  coextensive  with  the  analysis  of  linear  filters  on  o.    In  the  sequel. 
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the  matrices  (cj  .      .)  and  (y^    )  will  be  denoted  respectively  by 
C(t)  and  r(T),  while  the  displacement  transformation  corresponding  to 
r{t)  under  the  mapping  (1.29)  will  be  denoted  by  r(T;  jE""^)  .    Hence  (2.10) 
and  (2.11)  may  be  written,  respectively,  as 

(yj)  -  C(T)(fJ  (2.13) 

(yj)  -  r(T)(f^).  (2.14) 

By  virtue  of  (1.29),  (2.14)  has  the  equivalent  expression 

Y(T;E-^)e°  -  r(T,E-^)F(E-^)e°  (2.15) 
where  Y(tjE~^)  and  F(E~^)  denote  the  displacement  transformation  repre- 
sentations (1.32)  of  (yj^)  and  (f^).    It  is  now  evident  that  Y(OjE"^) 
is  just  the  "classical"  z-transform  and  Y(tjE~^)  Jury's  "modified" 
z- transform  [14]. 

The  first  type  of  sampled-data  system,  i.e.,  that  exemplified 
by  the  digital  computer,  is  described  by  a  difference  equation  of  the 
form  [15] 

W^Vl*-  •  '*\\-m  -  WVn-l*^2^n-2*-  •  -^^sV.  ^^'^^^ 
where  the  sequences  [u^j  and  [v^]  are  respectively  the  output  and  inpwt 

of  the  computer  and  the  a^,  b^  are  constants.    Since  the  analysis  of 
such  systems  by  the  present  methods  involves  no  concepts  not  previously 
discussed,  a  treatment  of  them  will  be  dispensed  with. 

Explicit  form  of  constant  linear  filters. — As  is  well  known 
[16]  the  Green's  function  v(t)  of  (2.5)  consists  of  a  linear  stun,  with 
complex  coefficients,  of  terms  of  the  form 

t  e  (2.17) 
where  m  is  a  non-negative  integer  and  a  ia  a  complex  constant.  Con- 
sequently, the  coefficients       (2.12)  of  the  transformation  r(TjE"^) 
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of  (2.15)  are  linear  sum  of  terms  of  the  form 

,  «m.  oh.n  (2.18) 
(n+x)  (e  ) 

80  that  it  may  be  concluded  that  r{T;E"-'-)  is  a  linear  sum  of  displace- 
ment transformations 

CO  , 

Z    (r+x)  (e    )  E    .  (2.19) 
r-O 


The  functions 

00 

*Jt;z)  -    2    (r+T)V,  n  -  0,1,2,...,  (2.20) 


are  rational  functions  of  z,  as  the  following  system  of  equations  showat 

n        QD       00  i  n  i  r 

*  (Tja)  .  T   +    2    I  2    (njj)T'^r  '^U  (2.21) 
r-1  j-0 


♦    2    (njj)TJ{  Z    T^-hn  (2.22) 
j-0  r-1 


t""  +    2    {n',^)x\    (z)  (2.25) 
j-0 


-  {  Al-z)"*^  *  ?  (n;j)TJ(l-z)\  .(z)}/(l-z)°*^  (2.24) 

J-0 

-  V'5''^/(^-^)°*'^-  (2.25) 
Inspection  of  (2.24)  reveals  that  R^i^^z)  is  a  polynomial  of 
degree  n  in  z,  with  R^(0j2)  .  S^(z).    An  explicit  form  for  the  coef- 
ficients of  the  powers  of  R^(t;z)  may  be  obtained  by  using  (1.41)  in 
(2.24).    However,  it  is  more  direct  to  write 
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R  (Tjz)  -    Z    hl{-c)z'^  -  2    (r+T)V.  (2.26) 

"  m-0  r-0 

There  results 

n  m-1 

b!^  (t)  -  (-l)'"(n+ljm)T°  +  Z  (njrh^    2  (-l)<^(n+l;q)(m-q)^-'',  (2.27)- 
"  r-0  q-0 

n—  l)2y...,n. 

From  the  foregoing  considerations,  we  deduce  that  r(T}E  ^) 
is  a  rational  function  of  E""'-  for  every  X6[0,l].    On  the  other  hand, 
it  is  a  commonplace  [16]  that  v(t)  has  a  rational  Laplace  transform. 
By  virtue  of  (2.2)  these  facts  establish  an  isomorphism  between  ra- 
tional Laplace  transforms  and  rational  displacement  transformations 
r(xjE~'^).    For  a  fixed  value  of  t,  the  correspondence  is  merely  a 
homoraorphism,  by  virtue  of  (2.3). 

(2.19)  and  (2.25)  imply  that  the  stability  character  of  the 
constant  linear  filter  represented  byr(T;E"-'-)  is  determined  for  any 
value  of  T 6 [0,1]  by  that  character  for  a  fixed  value  of  x  in  the  in- 
terval; i.e.,  the  poles  of  r(T;E"-^)  are  independent  oft.    The  cri- 
terion of  stability  for  continuous-data  control  systems  [16]  requires 
that,  for  stability,  the  real  parts  of  all  the  parameters  a  (2.17) 
appearing  in  v(t)  must  be  negative;  one  or  more  positive  real  parte 
imply  instability  and  one  or  more  zero  real  parts  imply  marginal  sta- 
bility.   From  these  facts,  together  with  (2.19)  and  (2.25),  we  may 
infer  that,  according  as  the  continuous-data  system  is  stable,  unstable 
or  marginally  stable,  its  sampled-data  counterpart  possesses  the  same 
property  and  conversely. 
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EiTor- sampled  feedback  systems. — In  the  sojuplest  instance  of 

a  system  of  this  type,  (2.13)  becomes 

(y^)  -  C(T)(f  -y°).  (2.28) 
n  n  n 

For  T  -  0,  we  have  from  (2.28), 

(y°)  .  [I  ♦  c(o)]-^c(o)(f^).  (2.29) 

The  inverse  of  I  +  C(0)  always  exists,  since  by  (2.08) 

-  0,  n  -  0,1,2, .. .  . 

Substituting  (2.29)  in  (2.28)  yields 

(yp  -  c(t)1i  -  [I  +  c(o)]-ic(o)}(f^)  (2.50) 

-  C(x)[I  *  C(0)]-^(f^). 

That  (2.30)  reduces  to  (2.29)  for  t  -  0  follows  from  the  identity, 
readily  proven  for  X , 

A(I  +  A)-l  -  (I  +  A)-1a.  (2.51) 
The  case  of  error- sanqDling  for  constant  linear  filters  leads 
to  the  revised  form  of  (2.15) 

T(TjE"-^)e°  -  P(T;E"-^)F(E-^)e°  (2.52) 

where 

P(,;E-^)  -  .  (2.55) 

1  +  r(0;E~-'-) 

On  the  basis  of  the  discussion  of  the  previous  section,  we  may  con- 
clude that  the  only  singularities  of  P(tjE~'^)  are  the  roots  of 

r(Oia-^)  -  -1.  (2.54) 
From  the  definition  of  stability  for  constant  linear  filters,  it 
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follows  that,  for  P(tjE~  )  to  represent  a  stable  filter,  the  roots  of 
(2.34)  must  lie  outside  the  circle  jz""^!  -  1  in  the  z~"'"-plane. 

The  analysis  of  more  complicated  feedback  systems  differs  only 
in  detail  from  that  giren  here. 

Remarks . — We  have  indicated  in  the  preceding  sections  a  rela- 
tively extensive  theory  of  constant  linear  filters  based  principally 
on  an  explicit  general  form  for  such  filters.    An  analogous  develop- 
ment cannot,  unfortunately,  be  supplied  for  variable  linear  filters. 
Several  factors  contribute  to  this  state  of  affairs:    there  is  no 
explicit  general  form  available  for  the  l.s.m.  C(t)  of  (2.15). 
Moreover,  since  <^  is  not  dense  on     ,  C(t)  cannot  be  expressed  as 
a  limiting  case  of  an  infinite  set  of  d.i.m.    C(t)  may  not  have  a 
pseudo-reciprocal;  we  have  previously  remarked  on  the  noncomrautativlty 
of  <^  . 

Friedland,  who  up  to  the  present  has  published  the  only  dis- 
cussion— known  to  the  present  author — of  variable  linear  filters  [12], 
[17],  has  introduced  a  formalism  for  such  filters  by  defining  a 
"w-transf orm" ;  however,  it  is  questionable  whether  the  use  of  this 
transfonn  offers  any  significant  advantage  in  theory  or  practice  over 
direct  consideration  of  C(t)  itself. 

Even  the  broad  question  of  stability  of  such  filters  is  left 
largely  open.    For,  whereas  the  small  investment  of  stability  in  a 

Q 

d.i.m.  earns  the  profit  of  reproduction,    the  same  requirement  for 

I.e.,  the  output  of  a  stable  constant  linear  filter  is, 
ultimately,  a  reproduction  of  the  input,  up  to  a  multiplicative 
constant  (vide  Theorem  II) . 
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a  l.s.m.  may,  as  Friedland  [17]  has  pointed  out,  result  in  a  filter 
\daich,  without  further  restriction,  is  not  "stable"  in  any  intuitively 
or  practically  acceptable  sense.    However  it  has  not  been  the  purpose 
here  to  investigate  in  depth  the  problem  of  variable  linear  filters  per 
se,  so  the  matter  will  be  left  at  this  point. 

Finally,  we  wish  to  call  attention  to  the  fact  that  the  theory 
of  sampled-data  systems  as  developed  here  may  be  subsumed  under  Zadeh's 
general  theory  of  linear  filters  [15].    Thus,  where  Zadeh  presented 
a  theory  for  "signal  spaces"  whose  elements  are  images  of  a  nondenum- 
erable  set,  we  have  effectively  extended  the  theory  to  cover  signal 
spaces  whose  elements  are  images  of  a  denunerable  set. 


CHAPTER  III 

NUMERICAL  INTEGRATING  OPERATORS 

Introduction . — Tustin  [18],  [19],  and  others  [20], . . . ,  [39] 
hare  in  recent  years  dereloped  a  finite  difference  method  for  the 
approxlaate  solution  of  ordinary  differential  equations  whose  appli- 
cation presupposes  the  arailability  of  a  certain  set  of  linear  (n-th 
order  integrating)  operators.    These  operators  are  characterised  by 
the  following  property:    let  f(t)  be  Riemann  integrable  on  the  inter- 
▼»1  [0,  tQ]  and  let  h  be  a  small  positive  constant.    Then  if  P~° 
denote  an  n-th  order  integrating  operator,  the  result  of  the  operation 

p-°<S)[f(0),  f(h),  f(nih)],  (3.1) 

whsre  tQ  -  oh,  is  a  sequence 

F(0),  F(h),  F(inh)  (3.2) 

for  vrtiich 

F(kh)=^/^   ...^   f(tl)dtl...dt^-ldt^  k  -  0,l,...,m.  (5.3) 
Several  different  sets  of  such  operators  have  been  introduced 
in  the  literature.    One  of  these  sets,  first  derived  by  Tustin,  we 
shall  refer  to  as  Type  I  operators.    Type  II  operators  were  derived 
by  Ragaszini  and  Bergen,  while  a  modified  form  of  these,  designated 
Tjrpe  III,  were  introduced  by  Boxer  and  Thaler.    Type  IV  operators  were 
an  innovation  of  Madwed  while  Cruickshank  obtained  Type  V  operators. 

The  aim  of  the  cited  references  is  utility,  often  at  the  ex- 
pense of  rigor.    However,  a  general  mathematical  treatment,  including 
an  error  analysis,  of  the  operators  of  Types  I,  II  and  III  has  been 
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given  by  Wasow  [40],    Wasow's  approach  is  via  a  certain  discrete 
approximation  to  the  Laplace  integreG.. 

In  this  chapter,  operators  of  Types  I,  II  and  IV  are  devel- 
oped as  linear  filters  on  a^,  the  space  of  all  real  sequences.  This 
development,  in  addition  to  being  of  an  inherently  more  elementary 
nature  than  Wasow's,  clears  up  several  questions  of  long  standing  with 
regard  to  application  of  the  operators  to  integrands  having  nonzero 
initial  values. 

The  application  of  numerical  integrating  operators  to  vari- 
able coefficient  differential  equations  given  in  the  sequel  is  new. 
The  only  previous  application  of  the  operators  to  such  equations  was 
by  means  of  an  algorithm  suggested  by  Boxer  and  Thaler  [33]  and  dis- 
cussed in  detail  by  Wasow.    The  present  method,  while  no  more  difficult 
to  apply  than  the  Boxer- Thaler  algorithm,  is  more  accurate. 

Tustin,  as  well  as  Boxer  and  Thaler,  has  atteiqjted  to  apply 
numerical  integrating  operators  to  the  approximate  solution  of  non- 
linear differential  equations.    No  such  application  is  contemplated 
in  the  present  chapter,  for  our  methods  are  linear  and  it  is  well 
known  from  experience  in  many  researches  that  the  application  of  lin- 
ear methods  to  non- linear  problems  is  invariably  considerably  less 
than  completely  satisfactory. 

Much  of  the  material  contained  in  this  chapter  has  already 
been  published  as  reference  [41] . 

Elementary  considerations. — In  later  sections  we  shall  need 
several  elementary  results  from  the  calculus  and  from  interpolation 
theory.    The  first  of  these  is  the  well-known  identity 
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//^.../^f(xl)dxl...drn-ldx«  -/ii:^^^  f(8)da,  n-1,2,5,...  .  (3.4) 

0  0        0  0  (n-l)l 

We  shall  consider  three  different  approxiBiations  to  the  values  of  the 
integrals  in  (5.4),  each  leading  to  a  different  type  of  integrating 
operator. 

Next,  suppose  that  f(t)  is  continuously  differentiable  on  the 
non-negative  real  axis,  that  f"(t)  exists  there  and  that  the  function 
and  its  derivatives  are  zero  elsewhere.    Then  in  each  of  the  closed 
intervals  [t^.^,  \]»  k  -  1,  2,  3,  with  tQ  -  0,  f(t)  has  the 

representation  [42]: 

f(t)  -  fk::£iEii(t-tj^_;L)  *  Vi  ♦  |(t-V(^W^"(^k)  (^-s) 

irtiere  f(kh)  -  fj^,  tj^  -  t^_-^  -  h  -  constant  and  t^_2^     ^k  *k* 
It  is  observed  that       -  i^j^(t)  and  that  (5.5)  deteradnes  f"(^jj(t))  as 
a  continuous  function  of  t  in  the  interior  of  the  interval.  Although 
f"(tjj(t))  is  not  defined  at  the  endpoints  of  the  interval,  the  right- 
hand  (left-hand)  limit  of  the  function  exists  at  the  lower  (upper)  end 
point,  so  that  with  the  expedient  definition  the  function  achieves  con- 
tinuity on  the  right  (left).    Thus  if  g(t)  is  an  integrable  function 
which  does  not  change  sign  on  the  intearval  [a,b],  iriiere 
tj^  ^  <  a  <  b  <  tj^,  then  by  the  first  mean  value  theorem  for  integrals 
we  have 

A"(Ut))g(t)dt  -  ^(Tl  )/g(t)dt  (5.6) 
a        k  k  a 

where  tj^_^  <  t,j^  <  t^^. 
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Finally,  we  define  the  rector  (p°)  as 
n  2 

(p^)  -  {^/^  ...j^  f(tl)dt^..dt'^-^dt«),  n  -  1,2,5,...,  (3.7) 

and  let 

+         n  2 

^n  _          j-t           f(t^)dt^...dt"-^dt",  m,  n  .  1,2,3,...,  (5.8) 

80  that  (5.7)  may  be  written 

(p2)  -  (  2    aJ),  n  -  1,2,5,...  .  (3.9) 
k-1 

Alternately  we  may  write,  by  virtue  of  (3.4), 

n  1 

(p")  -  (/^  (n.h-8)  '    f(8)ds),  n  -  1,2,3,...,  (5.10) 
»        u  (n-l)I 


(5.11) 


in  which  caae  we  let  ^ 

Ck- f(8)d«.  k,  n-  1,2,3,...  . 

\-l  (n-1)'. 

Then  it  follows  that  (3.10)  may  be  written 

(P^  -  (  ^  "  -  1>2,3,...  .  (3.12) 

Note  that  in  (3.9)  and  (5.12),  the  summations  appearing  in  the  vectors 
on  the  right  are  to  be  set  equal  to  sero  for  m  ■  0. 

In  the  following  analysis,  we  shall  restrict  our  considerations 
to  functions  possessing  a  representation  of  the  form  (3.5). 

Type  I  Operators.— From  (5.8)  and  (3.9)  we  obtain 

(pi)  -  (  Z    aj)  (3.13) 
k-1 


and 


a^-A      f(t)dt.  (3.14) 
""^k-l 
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Substituting  from  (5.5)  into  (3.14)  yields 


\  '  *  *  k  (t-t,)(t-t^_^)f"(^;;)]dt.  (5.15) 


r^k      1,.  .  . 


Noting  that  /^'^     i(t-tj^)(t-tj^_^)dt  .  -  ^  and  using  (3.6),  ve  see 


that  the  last  equation  reduces  to 

5 

\  ■  l<^k  *  Vl)  -  '""K^ 

where  Vl  <  "4  < 

Now  substituting  (3.16)  into  (5.13)  we  have 


(3.16) 


k-0     -  ~    «       ^  j^_Q 

With  (1.32)  and  the  readily  estabUshed  relations 


m 


^2     "  m  ^^J 


1-E 


-1 


(3.18) 


(3.19) 


and  the  fact  that  f  ^  -  0,  (3.17)  becomes 


(p^)  -  ^ 


F(E-l)  .  A 


1-E 


-1 


1-E 


^^-^(^•(n)).  (3.20) 
l-E"^ 


By  virtue  of  (3.20)  and  our  assumptions  on  f(t),  we  may  write 

1-E  1-E 
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where  f(-^)(t)  -  //  ...  /  f(t^)dt^..  dt^'^dt^ 

0  0  0 

and  f^^^(t)  -  d^f/dt^  for  positive  values  of  k,  while  f^°\t)  ■  f(t). 
Successive  reduction,  using  (3.20)  and  (3.21)  leads  to 

.-Ixn-l 


in 


h  1+E"^ 


%(E-l)e°.(Vf,iM:^eO  (3.22) 


}  i-E-y         2  u  (i_E-i)n 


_±''-^^  (Mii_(f(J*3.n)(^.J)), 
12  J-0    2J  (1-E-1)J*1 

This  equation  is  of  the  form 

(p^)  -  p-^(E-^)F(E-^)e°  -  C^(E-^)fo  c°  -  {t^)  (3.23) 

where  P~",  C^,  (e^)  may  be  designated  respectively  the  integrating 

operator  of  order  n,  the  correction  operator  of  order  n,  and  the  error 
vector  of  order  n. 

Type  II  Operators. — If  we  let 

g^(t)  -  t"-V(n-l)'.  f or  0  <  t  (3.24) 
-  0  for  t  <  0 

then  (3.11)  may  be  written 

For  a  fixed  value  of  m,  the  function  f(t)g'^(mh-t)  satisfies  the 
requirements  for  representation  by  means  of  an  equation  of  the  form  (3.5). 
This  representation  is 
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f(t)gn(,„h-t)  .  i(fi,gS.k  -  fk-l8S-k*l)(^Vl)  (5.26) 


ijhere  ^  -  g^(nih) .    From  tMa  and  (3.25)  we  obtain 


Substituting  this  result  into  (5.12)  yields,  after 

simplification, 

m 
Z 
k-0 


(3.28) 


u3    ^  j2 


The  last  equation  may  be  written  as 


(p!)  -  h 


S  m 


(  2  [f-(Tlj,)(inh-Tij^)""-^  -  2(n-l)f'(Tij^)(mh-Tij^) 


12(n-l)J  k-0 


n-2 


.n-3. 


+  (n-l)(n-2)f(T|i£)(mh-nk)  3) 
vhich  is  of  the  form  (5.25). 


(3.29) 


Except  for  the  case  n  -  1,  gg  ■       ^"01"  "the  exceptional  case  we 
note  that  we  have  Eq  -  g  (t)  -  1  on  the  interval  0  <  t  <  mh.  This 
yields  a  first  order  operator  that  is  identical  with  the  first  order 
Type  I  and  Type  IV  operators.    Previous  derivations  have  effectively 
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taken       -  0,  but  for  n  >  1,  the  above  integrating  operators  coincide 
with  Type  II  operators  derived  by  other  methods. 

From  (1.39)  and  (5.24)  it  is  determined  that  G^(E"-^)  has  the 
follovdng  expression  in  terms  of  Lawden' s  ^-functions  (supra,  p.  15) i 

G  (E-^)  -  (3.30) 
-'■  1-E"-^ 

GjE'^)  -7^*    T^^'^)'  ^  •  2»5,4,...  .  (3.51) 
"             (n-1) I  n-1 

Type  IV  Operators . —The  derivation  of  these  operators  is 
similar  to  that  of  the  Type  II  operators,  except  that  rather  than 
replacing  the  entire  integrand  of  (5.11)  by  a  piecevdse  linear 
approximation,  only  the  function  f(t)  itself  is  so  approximated. 
Thus,  replacing  f(8)  in  (5.11)  by  its  equivalent  form  (3.5)  and 
applying  (3.6)  results  in 


^mk 


1 

(Wi) 

(n-l)l 

h 

Ids  (3.32) 


Now  letting 


n  t 

A,(m,k)-A^     8J(t-s)nds,    n,  j  -  0,1,2,...,  (3.53) 
J  Vl 


we  find  that 


Aj-\m,k)  .  ^[(m-k+1)"  -  (m-k)"],  (5.54) 
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A!;'-^(m,k)  -  2^li[(k-l)(m-k+l)"  -  k(m-k)"]  +  i  A"(in,k)5  (5.55) 
■L  n  n 

A?-^(in,k)  -  ^[(k-l)2(m-k+l)"  -  k^(in-k)"]  +  ^  A??(iB,k).  (5.56) 
<■  n  n 


Substituting  theae  values  in  (5.52)  and  simplifying  the  result  gives 

b\  .  -iL~{(f  -f    J[(«-k+l)"*l  -  (ii^-k)"*^]  (5.57) 
(n+l)t      k  k-1 


+  (n+1)  [fj^_^(m.k+l)"  -  fj^(in-k)^]} 


n+2 

^  f"(^  J{  (n+2)  [(m-k)"*^  («-k+l)"*^] 


2(n+2) 


f  ^  'k' 


-  2[(m-k+l)"*^  -  (la-k)"*^]}. 


Substituting  this  result  in  (5.12)  gives 

(p^)  -  .^j^(  2  (fj^.fj^J[(m.k+l)"*^  -  (m-k)''*^])  (5.58) 


^%        ,vn+l       n+1     ,  n. 


,  n+2  in 

-  -7  r-(  2    f"(ri  ){(n+2)[(m-k)'^^  +  (m-k+l)^*^] 

2(n+2)!  k-0  ^ 

-  2[(ra-k+l)"*^  -  (m-k)"*^]}). 
The  (iB+l)th  component  of  the  first  vector  on  the  right  hand 
side  of  (5.58)  is  the  coefficient  of  E"*"  in  the  Cauchy  product 
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*(VW^"''-  "[(^1)"^^  -  r"*l]E-^  (3.59) 
r-0  r-O 

vhlle  the  (m+l)th  component  of  the  third  vector  is  the  coefficient 

of  E"'"  in  the  Cauchy  product 

I    f"(T1  )E-^.  ?{(n+2)[r^^  +  (r+l)"*l]  (3.40) 


r«0        ^  r-O 


Taking  (5.39)  and  (5.40)  into  account  and  performing  the  necessary 
expanaiona,  we  find  that  (5.38)  becomes 

(3.41) 

v,n  I  00 

'  tAtT^^-^^       2  [(n+lA)r"  (n+lik)r^-^*l  +...+l]E-^(f  ) 

"       (n+1)!  I..0  ^ 


h"f, 


(n+l)t 


°  ((m.l,Z)m"-l  +...+  (n+ljk)ra"-^*l  1) 


,  n+2  00 

-  :;7-TTT  ^  {(n+2)[2r"*^  +  (n+ljl)r"  (n+l;k)r^-^*l  1] 
2^n+Z;  li.,o 

-  2[(w.2,l)r"*^  (n+2jk)r''-^*^  +...+  IJlE"^. {f"(Ti  )). 

m 

Lawden  [7]  establishes  the  following  relation: 

(z-1-1)  ?^(t)  .  (n,l)  ♦  (n,2)  1l^_^{z)  ^^(z)  +  1. 

A  relation  more  convenient  for  our  pvirpoaes  is  obtained  by  replacing 
z  by  z"-"-  and  n  by  n+1  in  this  equation: 


+  (n+l;n)  ^^(z-l)  +  ^^(z-l)  +  1. 
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Finally,  applying  this  and  (1.39)  to  (3.41)  we  have  the  desired  result, 
of  the  form  (5.25), 


(pS) 


(n+1) I  E 
h"fn 


-1 


n+1' 


(3.42) 


(nfl) 


.n+2 


ilEi?    AE-h  '  (n+1)  ^jE'h 


(n+2) 


1+E 


-1 


^  ?  ^(E-^)  -  2 
1  n+1 


■1  n+2 


(f"(n  )) 
m 


2(n+2)lL         E"-^  E 
At  this  point,  a  continent  on  Type  V  operators  is  called  for. 
In  [41],  it  is  stated  erroneously  that  these  operators  are  in  a  sense 
a  variant  of  the  Type  II  operators.    Actually,  the  derivation  of 
Type  V  operators  from  the  present  viewpoint  is  effected  in  aLnost 
precisely  the  same  way  as  is  that  for  the  Type  IV  operators.  The 
only  difference  is  that,  rather  than  using  (3.5)  in  the  representa- 
tion of  f(t),  use  is  made  instead  of  the  mean  value  theorem  for  deriv- 
atives.   Since  the  resulting  operators  are  less  accurate  than  those 
here  considered,  the  details  of  the  derivation  are  omitted,  the  fore- 
going remarks  being  included  only  to  satisfy  the  reader's  curiosity 
and  to  conrect  the  erroneous  statement  of  [41] . 

Bounds  on  the  error  for  operators  of  types  I,  H  and  IV. — 


Let  |h(t) I"*  denote  the  maximum  value  of  |h(t) |  on  the  interval  [0,mh] 
and  let  |H(E"^)(fj^)  |^  denote  the  absolute  value  of  the  n-th  component 
of  the  vector  H(E~'^)(fj|j) .    From  (5,22)  we  obtain,  for  Type  I  operators, 


/ 
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J-0  2J 


E~^(H-E~^)'^ 


(1-E-1)J*2 


(5.45) 


m 


which  yields 


where 


12  j.o    gj  q-0 

r  -  m-l    for  m-1  <  j 
-  J       for  ra-1  >  j. 


(5.44) 


Now 

(Jjq)(j+ni-q5in-q-l) 


1  (5.45) 

r^xi^  .^^  .  f(j-q)^">][(j-q)^(m-l)]...[(j-q)^('n-j)]; 
U+l;qUJ-q;i  -<  J  +  1  factoro  > 

hence,  for  fixed  j  and  q,  the  interior  sum  of  (5.44)  is  a  polynomial  of 
degree  j+1  in  ra.    Since  mh  is  independent  of  h  we  conclude 

\tl\  <  hh{h)  (5.46) 

where  T(h)  ia  a  polynomial  in  h  whose  coefficients  are  independent  of  h. 
For  Type  IV  operators  we  have  from  (5.42) 


n+2   

;"|  <Jl  _|f"(t)r 

m'  -  2(n+2)! 


1+E 


(n+2) 
L  l-E 


-1 


¥    ,(E"^)  -  2  *  ^(E~^) 


-1  n+1 


.  (5.47) 


m 


In  particular,  by  using  (1.59)  in  conjunction  with  (5.47),  we  find  that 

(5.48) 


7[(n+2)m"*^  -  2m"*2  +  2(n+2)  "z^  f*^] 

>1 


2(n+2) I 

By  use  of  a  well-known  expression  for  the  summation  appearing  in  (5.48), 
(cf.  [42],  p.  157),  (5.48)  reduces  to,  for  m  >  1, 


n        f"(t)  I'" 

'^m'  -  \n*Z)l     [("+252)B2(mh)V  +,..+  (n+2}n+l)B^^^(rah)h"*^]  (5.49) 
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irfiere       is  the  i-th  flrat  order  Beraoulli  number  [42],  so  that  for 
this  type  of  operator  also,  the  error  magnitude  is  of  the  order  O(h^). 

Finally,  a  similar  analysis  of  the  error  vector  of  (3.29)  yields 
for  Type  II  operators  with  n  >  5 


le^l  <  ^ 


m   -  12(n-l)l 


^  lf"(t)r    2  (n}j)B„  .(in+l)J  (5.50) 


*  2h""^  |f(t)r        (n-ljj)B_  .  Art^l)^ 
J-1 


n-2 


♦  (n-l)h^-'  |f(t)r   £    (n-2,j)B^  ,  Jml)^ 

from  which  it  is  clear  that  the  magnitude  of  the  error  is  again  of  the 
order  0(h).    The  same  order  of  magnitude  can  be  obtained  for  n  ■  1,2,5. 

Hence,  if  we  Judge  the  error  only  by  its  order  of  magnitude,  we 
see  that  the  three  types  of  operators  possess  the  same  degree  of  accu- 
racy.   It  is  well  to  note  that  if  f q  /  0  and  we  use  only  P~'^(E~^)(fj,) 
to  approximate  (pj),  then  the  error,  for  all  three  types  of  operators, 
is  of  the  order  0(h).    This  is  verified  by  observing  that  this  is  the 
order  of  magnitude  of  the  m-th  component  of  the  vector  fQC^(E~^)  . 

A  deeper  analysis  of  the  error  does  not  appear  easy.  However, 
several  arguments  may  be  advanced  for  preferring  the  use  of  Type  IV 
operators  in  the  applications,  the  roost  compelling  of  which  is  that 
the  error  vector  contains  the  least  number  of  independent  quantities 
of  the  three  types  of  operators  we  have  studied. 
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Approximate  solution  of  linear  ordinary  differential  equations. — 
We  shall  apply  the  results  of  the  preceding  section  to  the  approximate 
solution  of  linear  ordinary  differential  equations  of  the  form 

2  (         )  .  f(t)  (5.51) 

j.o  dtJ 

where  the  a^,  1  «  0,1, ...,n,  are  functions  only  of  the  Independent 
(real)  variable  t.    We  assume  that  a^_j  Is  continuous  on  erery  finite 
interval  [0,t3  and  J  times  dlfferentlable  on  the  interior  of  the 
interval.    It  is  assumed  further  that  f(t)  is  an  Integrable  but  other- 
wise arbitrary  function  on  the  same  Interval.    Finally,  we  assume 
a^  /  0  on  the  interval. 

The  equation  of  (5.51)  is  not  as  restrictive  as  it  appears 
at  first  glance,  for  by  use  of  the  identity 

4:  (^)  -    2  (k,j)  ^  .  (3.52) 
dt*^  J-0  dt^'^  df' 

where  (kjj)  -  k'./[  J'.(k-J)  I  ],  (5.51)  maybe  put  in  the  form 

n  .j 

2    ^n  1  ^  -  (3.55) 
J.0   "J  dtJ 

with 

b.  -    2    (n-kjn-j)  — a^,  j  -  0,1,  ...,n.  (3.54) 
k-0  dt^"*" 

With  the  additional  assumption  that  the  bj  are  n-J  times  dlfferentlable, 

an  inductive  argument  from  (5.54)  yields  the  reciprocal  relations 


a,  -    2    (-1)^    (n-kjn-j)  2.         b.,  j  -  0,1,2, ...,n. 

J    k-0  dt<^-^ 
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The  proof  ia  relegated  to  the  Appendix.    Thus  the  subsequent  analysis 
applies  as  well  to  equations  of  the  form  (3.55)  vdth  the  just-noted 
restriction  on  the  hy 

Integration  of  (3.51)  between  the  limits  0, t, — n  times 
repeated — results  in 

Z    D-^(a.y)  -<P(t)  (3.55) 
J-0  ^ 

where 

D~V  -  /A  ...  A  y(tJdt,   ...  dt,  ,dt.,  k  -  1,2,3,...}  (5.56) 
0    0  0  K-j.  K 

D"°y(t)  -  y(t) 


F(t)  -  D-'^f(t)} 

2  Z 

j-0  k-0  J* 


n-1    J    Ki  kt^ 

f(t)  -  F(t)  +    2     Z  }  (5.57) 


Kj  -  [-^  (aky)]t.o>    j'  ^  •  0,1,-.., (3.58) 


In  (3.55),  we  put  t  ■  mh  and  use  (3.23)  to  write  the  corresponding 
vector-matrix  equation: 

Here  we  have  expanded  the  notation  used  earlier  to  include 

P-°(E-1)  -  Ij 
Co(E"^)  -  0, 
(ej  -  (0,0,...). 
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We  define  the  vector  (yj  by  means  of  the  equation 
k-0 

then,  putting  6^^^  •  yj„  -  V  ^  (^'^^^  ^^'^^ 

k-0  k-0 

Now  let 

P-^(E-^)  -    I  E"^, 
r-0 

then  the  corresponding  d.i.m.  is  (P^j)  vhero 


Pij    -  Pi_j. 


Using  this,  we  write  the  vector-matrix  equation  equivalent  to  (5.61): 

2    (P^)(ai_«  )  -  (  ^  (3.62) 
k.O  k.O 

Carrying  out  the  indicated  imiltiplication  in  (5.62)  results  in 

n       m     ,  n 

k-O    j-0     ^  ^  k-0 

which  in  turn  yields 


J.0  k-0  ^  k-0 


Now  define  xj^j  as 
.n        ?  _k 


Xjj  -    2    Pi.-|\j_i.  iJ  -  1,2,3,...  .  (3.65) 
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Using  (5.65),  (5.64)  Hiay  be  wrttten  as 
a  n 


(3.66) 


or,  equiralently,  as 


n 


k-0 

Proii  the  foragoing,  it  is  elaar  that  if  we  put 

(it,;  -  (%)  *  7o    ^    %0Ck(E"^)  ^^-^^ 
k-0 

then  (5.60)  may  be  written  as 

{xl^UvJ  -  (iij.  (5.69) 

The  formulation  is  now  complete.  In  the  following  sections  v 
shall  first  use  (3.66)  to  demonstrate  that  appnadaates  y^^  with  the 
accuracy  0(h  )  and  then  solre  (5.69)  for  y^^^. 

Accuracy  of  the  approximate  solution. — Prom  (5.66)  it  is  seen 

that  6n  -  0.    For  m  >  1,  we  readily  obtain 

^  -  (3.70) 

l\l  <T;^H=  ^  l^ml  *  "m-l"^    l>S+i,n^ll},  -  .1,2,5,... 

n  m-1   n  ^ 


k-1 

where       •  max  1 6,.  | . 
l<r<3B 


n  k.i    »  k-0  "'^ 
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By  our  initial  assumptions  about  the  aj(t),  j  -  0,1, ...,n,  there  exist 
positive  numbers  Lq,  Uq,  U^, ...,U^  such  that 

Lo<  l^O^^^l  l^o" 


|a^(t)llU^ 


for  0  <  t  <  inh. 


Using  these  bounds  with  (3.71)  yields 

n  m-l  n 

Now  suppose  that  mh  is  fixed  and  that  h;j^  is  a  fixed  constant 
such  that  0  <  h  <  h-,^.  Then  any  of  (3.46),  (5.49),  (3.50)  imply  that 

ra      ,  p 
k-1 

where  K  is  independent  of  h. 

If.  for  a  sufficiently  small  value  of  h,,  1  -  —   2  ^IpqI 

k-1 

is  uniformly  bounded  away  from  zero  on  [0,h^]  and  if 

^l^    2   U  Ip^    I  is  uniformly  bounded  above  on  the  same  interval,  then 

>ik.o  ^  "^-J 


the  condition 

Si-1  1 

implies,  through  (5.72),  that 


<  Lh^  (5.75) 


|6^1  <  Mh^  (5. 74) 


where  L,M  are  constants.    Moreover,  since 

%  -  niax  [|6^|,  a^_^], 
(5.75)  and  (5.74)  imply  that 


aj„-0(h^).  (5.75) 
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From  (5.72)  we  have 


lo  k.l   ^  ^ 


1 


2  I  <  Rh^ 
k-1  ~ 


and  from  this  we  infer  by  mathematical  induction  that  (3.75)  is 
true  for  all  positive  integral  values  of  m,  contingent  of  course 
upon  the  boundedness  conjectured  previously.    This  boundedness  is 
established  in  the  Appendix. 

We  conclude  that,  for  each  of  the  operators  considered  herein, 
y^  approximates  y^^^  to  the  order  0(h  )  for  positive  integral  values  of  m. 
As  noted  previously,       ■  yQ.    Parenthetically  it  should  be  observed  that 
an  equation  similar  to  (5.67),  and  used  in  the  same  connection,  appears 
to  be  treated  incorrectly  by  Wasow  [40] . 

The  solution  of  (5.69).— The  solution  of  this  equation  is  of 
course  Just 


when  the  inverse  exists.  For  this  existence,  the  following  condition 
is  sufficient  ( supra,  p.  7) : 


In  the  event  that  (3.77)  is  violated  for  every  value  of  i,  then  a 
pseudo-reciprocal  may  still  exist,  the  sufficient  condition  for  this 
existence  being  an  analogue  of  (3.77), 


(5.76) 


Xji  -    Z    Poak,i-l  /  0,  i  -  1,2,5,...  . 


(3.77) 
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With  the  aBSumption  that  (3.77)  is  satisfied,  the  determination 


of  {\^)  is  obtained  from  (1.10)  as 


x;^  -  (-1)^"^  d.t  u^y  n  X^' 


II 


where 


n 


det  ni^^  •  1; 


det  u). 


n 


^-IJ  Vl,J+l 


0  ...  0 
0  ...  0 


0 
0 


•    ■  • 


Vl,i-2  Vl,i-1 
\,i-Z  \,i-l 


(5.78) 

(5.79) 
, J-1,2, . . .,i-l. 

(5.80) 


Alternatively,  from  (l.ll). 


^-n       |.-n  . -n     ^n       . -n  .n       . -n     -i  /^n 

\i  '  -^\j\i  *  H-l,j'l,i-l  ''j+l,j'^,J+l^/''jj' 


(3.81) 


(5.82) 


j  •  1,2, .. . ,1-1. 

In  the  event  that  the  coefficients  *-j(t)  of  (5.51)  are  constants- 
call  them  a J— then  the  equivalent  forms  of  (3.78),  (5.79)  and  (5.80) 

for  this  case  can  be  obtained  directly  from  (1.12)  and  (1.15).  The 
displacement  transformation  corresponding  to  the  resulting  d.i.ra.  for 
the  solution  y^  is  readily  obtained  by  the  methods  of  the  first  chapter 
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[1+2  a,p-^(E-^)](y  J  - 
J.1  ^ 


r       ,      n-l    s         /      N  h'njE'h 
*(E-^)  +  2  [  2  ay=-^)(0)]—  

a-1  r-0    ^  ,  ^ 

(5.83) 


where  *(E""^)6^  -  (f,^).    Thl»  representation  of  the  approxljnate  solution 

is  easier  to  use  than  the  corresponding  d.i.m.,  for  it  is  only  re- 
quired to  operate  on  (3.85)  by  the  inverse  (or  pseudo inverse)  of 

n        .     -  , 

1+2  a  .P"''(E    ) .    Since  this  operator  is  rational,  as  is  *(E"-^)  in 

most  applications,  the  indicated  operation  amounts  to  nothing  more 
than  long  division  of  one  polynomial  by  another. 

Remarks. — It  has  previously  been  remarked  that  T^ype  IV  operators 
are  to  be  preferred  for  approximate  quadrature  by  virtue  of  the  simpli- 
city of  the  associated  bound  on  the  error.    This  preference  is  retained 
in  the  application  to  constant  coefficient  differential  equations  for 
the  same  ireason. 

Our  analysis  has  not  precluded  the  use  of  any  of  the  three 

types  of  operators  in  the  variable  coefficient  case;  however.  Type  I 

operators  may  be  dismissed  on  a  practical  basis,  since  the  general 

If 

form  of  the  coefficients  P^.j       too  ctimbersome  for  computational  pur- 
poses when  compared  to  that  of  the  other  types.    It  is  worthwhile  to 
exhibit  here  the  general  forms  of  the  p^  j  for  Type  II  and  Type  IV 
operators  for  k  >  1: 
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h,  i  >  j 


(k-l)l 


(i-j)    ,  i  >  J,  k>  1 ; 


(3.84) 
(Type  II); 


(k+1)! 


(3.86) 
•(Type  IV). 


^'^      [(i-J+1)^*^  -  2(i-j)"'"  *  (i-J-1)'^^"],  i  >  J 


,k+l 


Ml. 


Of  course,  for  both  types  we  have 

the  Kronecker  delta. 

It  thus  appears  that  in  the  variable  coefficient  case  the  com- 
putational convenience  of  the  Type  II  operators  may  be  an  overriding 
advantage.    Perhaps  even  more  important  Is  the  fact  that,  for  Type  II 
operators,  condition  (3.77)  reduces  to 

^ii  •  *0,i-l  *  I  *l,i-l  ^       ^  '  1,2,5,..., 

which  is  considerably  simpler  than  the  corresponding  expression  of  the 
condition  for  Type  IV  operators. 


COMPENDIUM 

In  this  disaertation  an  attempt  has  been  made  to  establish 
on  a  rigorous  basis  two  fields  of  current  interest  in  applied  mathe- 
matics and  engineering.    As  a  consequence,  many  of  the  important 
mathematical  expressions  that  have  appeared  in  the  foregoing  pages 
have  already  appeared— in  varying  degrees  of  generality— in  the  work 
of  earlier  investigators  in  these  fields.    It  is  not  amiss  therefore 
to  enumerate,  for  the  benefit  of  the  reader  who  is  not  a  cognoscente 
of  these  fields,  what  the  author  deems  to  be  the  primary  contributions 
of  this  dissertation  to  the  subject  fields. 

A  class  of  linear  transformations  on  a  sequence  space — the 
linear  filters— has  been  discussed  and  shown  to  constitute  a  suitable- 
even  a  "natural" — mathematical  representation  for  the  class  of  linear 
sampled-data  systems.    This  representation  on  the  one  hand  Justifies 
the  use  of  Infinite  matrices— implicit  in  the  work  of  Friedland  [12]  — 
in  the  analysis  of  sampled-data  systems.    On  the  other  hand,  the  in- 
troduction of  the  displacement  transformation  as  an  alternate  repre- 
sentation of  a  constant  linear  filter  provides  the  necessary  justifi- 
cation for  the  use  of  the  z-transform  in  the  study  of  time-invariant 

7 

Since  the  completion  of  the  peniiltimate  draft  of  this  disser- 
tation, a  more  recent  paper  by  Friedland — "Theory  of  time-varying 
sampled-data  systems,"  Tech.  Rep.  T-19/B,  Columbia  University  Elec- 
tronic Research  Laboratories,  April,  1957— has  come  to  the  author's 
attention.    In  this  paper  Friedland  indicates  an  awareness,  not  evident 
In  [12],  of  the  applicability  of  infinite  matrix  theory.    In  partlo- 
ularj,  he  utilizes  the  Kojima-Schur  theorem  for  stability  consider- 
ations.   However,  being  more  concerned  with  the  "w- transform"  and  with 
applications,  he  has  not  pursued  the  topic  to  the  depth  and  generality 
of  the  present  work. 
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sampled-data  aystems.  Moreover,  the  complete  equivalence,  In  this  c&ae, 
of  the  matrix  and  transformation  techniques  has  been  established. 

Two  mappings — one  an  isomorphism  and  the  other  a  homomorphism — 
of  the  class  of  linear  sampled-data  systems  on  the  class  of  linear 
filters  have  been  studied.    In  the  class  of  constant  linear  filters, 
the  isomorphic  mapping  leads  to  the  counterpart  of  Jury's  "modified" 
«- transform  [14]  while  the  horaomorphic  mapping  leads  to  the  counter- 
part of  the  "classical"  z-transfonn}  one  conclusion  to  be  drawn  is 
that  Jury's  transform  is  not  a  modification  of  the  z-transfonn  but, 
on  the  contrary,  the  z-transform  is  to  be  considered  a  special  case 
of  Jury's  transform.    In  the  class  of  variable  linear  filters  the 
homomorphic  mapping  leads  to  the  matrix  formulation  which  is  the  coun- 
terpart of  Friedland's  [12].    The  isomorphic  mapping  leads  to  a  more 
general  formulation — of  which  Friedland's  is  a  special  case — which 
apparently  has  not  been  previously  derived  although  the  possibility  of 
such  a  formulation  has  been  discussed  by  Friedland  in  a  recent  paper 
(see  footnote  7). 

Finally,  with  regard  to  sampled-data  systems,  the  importance 
of  the  use  of  Lawden's  'f-functions  [7]  for  canonical  representation 
of  the  time-invariant  sampled-data  systems  has  been  indicated.  This 
point  seems  to  have  been  overlooked  by  American  investigators  and  to 
have  been  exploited  to  only  a  limited  extent  by  British  investigators. 

The  remainder  of  this  work  has  consisted  of  a  thorough  ana- 
lytical study  of  the  method  of  numerical  quadrature  conceived  by 
Tustin  [18],  [19]  and  extended  in  various  ways  by  others.    Use  of  the 
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dual  matrix- transformation  techniques  developed  in  the  first  chapter 
has  permitted  putting  Tustin's  ideas  and  their  extensions  on  a  rigor- 
ous foundation  involving  only  elementary  concepts  from  the  calculus. 
The  development  has  at  the  same  time  permitted  retention  of  the  oper- 
ational form  characteristic  of  Tustin's  methods. 

The  importance  of  a  correction  for  non-zero  values  of  the 
integrand  has  been  put  in  evidence  together  vdth  a  general  form  for 
the  correction  term  which  is  believed  to  be  new,  as  is  the  expression 
for  the  general  form  of  Madwed's  integrating  operators.    Bounds  on  the 
error  for  this  method  of  nxunerical  quadrature  have  been  derived  in  a 
form  essentially  different  from  those  given  by  earlier  investigators. 
Finally,  a  new  algorithm  for  the  application  of  the  method  to  the 
numerical  solution  of  linear  ordinary  differential  equations  has  been 
derived  together  with  an  estimate  of  accuracy. 
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APPENDIX 


Definition  of  "algebra" . —The  definition  parallels 
that  of  [3].    A  Bet  X  is  an  algebra  over  a  field  of  scalars,       if  and 
only  if  the  elements  of  X  admit  the  three  operations  of  addition,  mul- 
tiplication and  multiplication  by  a  scalar,  subject  to  the  followljttg 
conditions: 

i)    X  is  an  Abelian  group  under  addition 
ii)    fcr  every  ae*  and  every  x»X,  there  is  a  uniquely  defined 

product  ax  -  xa  in  X  (multiplication  by  a  scalar) 
iii)    (a+p)x  -  ax  ♦  px^ 
iv)    a(x+y)  -  ox  +  ay 
v)    a(px)  •  (ap)x 
vi)    l«x  -  X 

vii)    for  every  ordered  pair  x,yeX,  there  is  a  unique  product 
xyeX 

viii)    (xy)  z  -  x(y»)  ^ 


^  where  x,yeX  and  l,a,pe* 


ix)    x(y+z)  -  xy  +  xzj  (x+y)z  m  xz  *  j% 
x)    axpy  -  apxy 
If  in  addition  there  exists  an  element  e  such  that 

xi)    ex  ■  xe  -  X  for  every  xeX 
then  X  is  called  an  algebra  with  unit  element. 
If,  for  every  x,yeX, 
xii)    xy  -  yx 
then  X  is  called  a  commutative  (Abelian)  algebra 


where  x,y, zel 
and  a,^ti> 
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If  X  satisfies  conditions  i  through  vi  only,  it  is  called  a  linear 

vector  space  over 

Derivation  of  relations  reciprocal  to  those  of  (5.54). — 

Let  us  suppose  that 

a.  -    Z  (-l)J-^(n-kjn-j)^ii-  b.  ,  j  -  0,1, . . .  ,m-l,  (Al.l) 

wh«re  m  <  n.    Then,  letting  j  -  in  in  (3.54),  and  using  (Al.l)  we  obtain 

a    -  b    -    Z     Z  (-l)^"^(n-kjn-m)(n-Jjn-k)5^  b  (A1.2) 

™  k-0  J.0  di^-J  ^ 

Now,  it  Is  trivial  to  show  that 

(n-kjn-ra)(n-j5n-k)  •  (n-jjn-m) (m-jjm-k) 

80  that,  assuming  (ajb)  -  0  for  a  <  b,  (A1.2)  can  be  written 


m-1  m-1  ^m-j 
aj.  -  b-,  -    2     Z  (-1)  "'^(n-Jjn-m)(m-Jjm-k)— —  b. 

j-0  k-j  dt"-J  J 


(A1.3) 


or 


m-1  .  A^-i  m-k+l 

a«  .  b„  +  Z  (-l)'"-J(n-Jjn-m)2  ^  b.{  Z  (-1)  (ra-Jjni-k^ 

^  J-0  dt"-J       k.J  (A1.4) 

But  the  quantity  in  braces  in  (A1.4)  has,  by  a  well-known  property  of 

the  binomial  coefficients,  the  value  one.    From  (3.54)  we  have 

so  that  with  this  and  (A1.4)  it  follows  by  finite  induction  that  (Al.l) 
is  true  for  J  •  0,1, ...,n. 

Oddly  enough,  the  author  has  been  unable  to  find  this  inter- 
esting and  useful  little  theorem  proven  elsewhere. 
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Proof  of  boundedness  of  expraaalons  oont&lned  In  (5.72). 


From  (3.84),  (5.85)  and  the  expression 


(A1.5) 


for  Type  I  operators,  it  is  clear  that 


(A1.6) 


is  uniformly  bounded  away  from  zero  when  0  <  h  <  h^  provided  a  suffi 


the  boundednesa  is  demonstrated  by  showing  that,  for  each  of  the  three 
types  of  operators,  (A1.7)  is  a  polynomial  in  h  on  any  interval  [0,h-j^]. 
The  maxiimira  of  the  polynomial  on  any  such  interval  then  serves  as  a 
unifonn  upper  bound. 

First,  (A1.7)  is  replaced  by  its  simpler  equivalent 


ciently  small  value  of  h^  is  taken. 

For  the  remaining  expression. 


(A1.7) 


m-l  n 


k 


(A1.8) 


Using  (5.84),  (A1.8)  becomes,  for  Type  II  operators. 
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ni-1  n  U  h^J^"^ 

Z  {  U^h  +    2  -^__-}  (A1.9) 

n     Ujh^  m-1 

.  Ui(mh)  -  Uih  ♦    Z   y-iLy-  (  Z  (Al.lO) 

k-2  ^^-1^'  j-1 

Vjirah)  -  U-j^h  +  2  -~-[mk+(kjl)BjLm^"-^+. .  .+(k|k-l)Bjj_;j^m]  (Al.ll) 

1-   n    J£  • 


k-2 

n   U,  k-1 


-  Uj^(nih)  -  U^^h  +    2   ^    Z    (kj8)Bg(inh)^"V.  (A1.12) 
k«2    '  s-0 

The  transition  from  the  second  to  the  third  member  in  this  chain  of 
equalities  depends  on  the  expression  for  the  interior  sum  given  in 
[42],  p.  137. 

For  Type  IV  operators,  (A1.8)  becomes,  by  virtue  of  (3.85), 

"z^  Z  h\[(j+l)^*^  -  2j^*^  +  (j-l)^*^]/(k+l)l  (A1.15) 
J-1  k-1  ^ 

which  readily  simplifies  to 

k.i  (k+l)l 
or,  finally, 


n  u 

Z 

k 


1       U  k 

,  j-X-  {  Z  (.l)^-J(k+l,j)(mh)V-J  -  h^}  (A1.15) 
1  ^i^*^)'  J-O 

For  Type  I  operators,  it  follows  from  expansion  of  P'^^CE"-^) 
in  (3.22)  that 

p;  -  {^)^   I     (k5r)(k+J-r-l;j-r)  (A1.16) 
J  r-0 

vrfiere  the  notation  indicates  that  j  is  the  upper  limit  of  the  summation 
for  j  <  k  and  k  is  the  upper  limit  otheiTri.se. 
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Hence,  uaing  (A1.16),  (A1.8)  becomei  in  tMs  o&se 

ra-1    n  ,  J<k 

1  2  ^    (k,r)(k+J-r-ljJ-r)}  (A1.17) 
j-1  k-1  r-0 

or,  in  a  more  convenient  fonn, 

n        ,  ,  m-1  j<k 

2  2  I  (kjr)(k+J-r-l,J-r).  (A1.18) 
k-1      ^      j-1  r-O 

An  expreasion  analogous  to  that  of  (3.45)  reveals  that  the  interior  sum 
of  (A1.18)  is  a  polynomial  of  degree  k-1  in  j.    Hence,  application  of  our 

m-1 

handy  device  from  [42],  p.  157,  to    2  evinces  the  fact  that  the 

J-1 

interior  double  sum  in  (Al.lB)  is  a  polynomial  of  degree  k  in  ra.  As 
with  the  preceding  two  cases,  (Al.lS)  may  then  be  expressed  as  a  poly- 
nomial in  h  with  constant  coefficients. 
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